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~ The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 

All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . This communication is responsive to 12 September 2009 . 
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391. 
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International Bureau (PCT Rule 17.2(a)). 
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THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 
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INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 
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Paper No./Mail Date . 
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each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 
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DETAILED ACTION 

• The application was forwarded to the examiner on 1 2 September 2009. 
EXAMINER'S AMENDMENT 

1 . An examiner's amendment to the record appears below. Should the changes 
and/or additions be unacceptable to applicant, an amendment may be filed as provided 
by 37 CFR 1 .312. To ensure consideration of such an amendment, it MUST be 
submitted no later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview 
with Michael Zazzara on 1 1 November 2009. 
Please amend the claims as follows: 

In claim 1 , line 1 , delete [;] and insert - coupled to a computer, the computer 
programmed to perform the steps of: - after "a virtual keyboard" 

In claim 49, line 1 , insert -- using a computer to perform the steps of: -- after 
"comprising:" 

Please delete claims 37-38 and 45-48. 

REASONS FOR ALLOWANCE 

2. The following is an examiner's statement of reasons for allowance: The 
application has features recited in the claims such as "mathematically integrating, using 
Bayes' theorem, the probability estimates of the plurality of channels to produce 
integrated probability estimates of candidate words corresponding to the stroke", "a 
computer for producing a probability estimate of a candidate word, wherein the 
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computer produces the probability estimate of the candidate word by first serially 
applying the output of each channel of the plurality of channels alone and separately, 
and if a recognized word cannot be identified from the output of any one channel, then 
the computer mathematically integrates outputs of at least two channels of the plurality 
of channels to produce an integrated probability estimate of the candidate word" and 
"calculating a total normative time of inputting the stroke for each word i, as follows: 

t n (i) = na + 6g log 2 (—^- + 1) 

where D k k+l is a distance between the k' h and the (k + \)"' letters of word i on the 
keyboard; W is a key width, n is a number of letters in the word; and a and b are two 
constants in Fitts' law, calculating a total normative time of inputting the stroke for all 
words of a gesture production, as follows: 

and if t a <t n (i), then a ratio t n {i)lt a \s used to adjust distribution of the probability 
estimates so as to lower the weight of the location channel," which are distinct 
comparing with the reference searched and cited by the examiner in the PTO-892 form. 

Any comments considered necessary by applicant must be submitted no later 
than the payment of the issue fee and, to avoid processing delays, should preferably 
accompany the issue fee. Such submissions should be clearly labeled "Comments on 
Statement of Reasons for Allowance." 
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Conclusion 

3. Claims 1-2, 4-6, 8, 11-12, 14, 17-19, 21-23, 30, 32, 35, 43-44 and 49-65 are 
allowed. 

4. The prior art made of record is considered pertinent to the disclosure of the 
application: 

• Carmen, II (US 5,454,046): A universal symbolic handwriting recognition system 
or converting user entered time ordered stroke sequences into computer 
readable text is described.The system operates on two levels: (1) a word-level 
recognizer, which recognizes the entire group of strokes as a unit, and (2) a 
parser-level recognizer, which breaks the strokes into segments and recognizes 
groups of stroke segments within a word, thus recognizing separate characters 
or character sequences within a word to build a complete recognition string. In 
both recognition levels, the system trains on actual user samples, either on an 
entire word, or on a character or character sequence within a word. It does so by 
building a user specific sample recognition data-base file of text/pattern pairs, 
where the text is specified by the user in a word confirmation process and the 
pattern, composed of an index and a feature vector, is created from the actual 
user input strokes. Thus, as the user continues to use the recognition system 
and augments his/her user specific sample recognition data-base file, the correct 
recognition rate climbs approaching 100 percent in normal usage. The word-level 
recognizer can also be used to train on abbreviations, custom shorthands, and 
pictographic characters, such as the Japanese Kanji, or Chinese. An abbreviated 
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Japanese Kanji or Chinese handwritten entry can even be trained for recognition. 
The text in the user specific sample data-base file is maintained in the Unicode 
format, and the user can specify the recognized return string format as either 
Unicode, ANSI, or JIS. 

• Lui et al. (US 6,788,815 B2): A user interface allows a user to input handwritten, 
key-press, and spoken text in a seamless, synchronized manner. A text input 
panel accepts soft keyboard presses and handwritten words, characters, and 
gestures. A text recognizer/synchronizer integrates textual input from various 
sources while recognizing and preserving the order in which a user entered text 
via the soft keyboard via handwriting, and/or by speaking. Synchronized text 
may be displayed in a stage area of the text input panel before being passed to 
an operating system message router and/or an application program. While in 
handwriting recognition mode, various permutations and combinations of a word 
recognition area, a character recognition area, and a keybar/keypad may 
optionally be displayed. 

• Kawamura et al. (US 2002/0071607 A1): A handwriting recognition apparatus is 
disclosed. In one embodiment the apparatus comprises an input device having a 
handwriting input area and configured to input a plurality of strokes constructing a 
plurality of characters written successively on the handwriting input area, and a 
recognition device configured to recognize the characters based on the strokes 
input by the input device, shapes of the strokes constructing two characters 
which are written successively and positional relations between or among the 
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strokes constructing the two characters, whenever one stroke is input by the 
input device. 

• Niemeier (US 5,574,482): A method of input programmed to operate on a 
representation of a keyboard appearing on a touch-sensitive screen in which 
letters are made temporarily available to the user based on studies of frequency 
of occurrence and sequence in the language that may then be selected for input 
by a sliding motion of an input device. The user slides an input device from the 
initially selected letter into the area representing any of the temporarily available 
keys, inputting any of the letters represented thereon. The process of selecting 
by touch and slide may be repeated as desired by the user. A method of 
capitalization is provided by touching the screen with an input device on the 
background area of the keyboard outside of the area representing the key or a 
letter and then sliding the input device into the area representing the key of the 
letter. A method of spacing is provided by a sliding movement of an input device 
from within the area representing the key of the last character before the desired 
space into the background area of the keyboard outside of the area of the key 
and then lifting the input device from the surface of the screen. 

• Milewski et al. ("Medical Word Recognition Using a Computational Semantic 
Lexicon"): The purpose of the invention is to construct a hybrid semantic network 
and computational mind capable of taking related words from an NPL oracle 
machine and producing with higher confidence. 
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• Kristensson ("Design and Evaluation of a Shorthand Aided Soft Keyboard"): A 
major drawback of mobile computing is the lack of an efficient text entry method. 
Previous attempts of handwriting/ gesture recognition or stylus soft keyboards 
have been shown to be inefficient, inaccurate or very hard to learn. In this work, 
we utilize the ATOMIK alphabetically tuned and optimized stylus soft keyboard 
and introduce the concept of word-level shorthand strokes formed after the 
corresponding keys on the keyboard layout. Since the gestures are scale and 
partially location independent, they require little or no visual attention from the 
user. An implication of Zipf s law is that the most common words make up a large 
percent of the text mass - in the 100 million words large British National Corpus 
the 100 most common individual words make up 46% of the entire corpus. Hence 
the largest performance gain is acquired by introducing gestures for only a 
limited subset of the English language and utilizing the soft keyboard for the rest. 
A gesture recognition engine based on elastic matching was developed and a 
working prototype system was used in a longitudinal pilot study involving six 
subjects. The study showed that the users learned about 58 shorthand gestures 
on average after four sessions of 40 minutes practice. Their rate of learning was 
rather constant across sessions, acquiring about 15 new words in each session 
of practice. 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JOHN Wahnkyo LEE whose telephone number is 
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(571)272-9554. The examiner can normally be reached on Monday - Friday (Alt.) 7:30 
a.m. - 5:00 p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Samir Ahmed can be reached on (571) 272-7413. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/CHARLES KIM/ 

Primary Examiner, Art Unit 2624 



/John Wahnkyo Lee/ 
Examiner, Art Unit 2624 



